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(54) Device-independent and medium-independent color matching between an input device and 
an output device 



(57) The present invention is directed to a method 
and apparatus for improving color matching between 
original color images and reproductions thereof. In the 
present invention, color space transformations are de- 
rived for a color image reproduction system comprising 
an input device and an output device by obtaining a first 



transformation for the input device that maps from colors 
within an input-device-dependent color space to colors 
within a first device-independent color space, and ob- 
taining a normalization transformation that normalizes 
information obtained from the first transformation with 
respect to a white point in a second device-independent 
color space. 
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Description 

TECHNICAL FIELD 

[0001] The present invention relates generally tocolor 
image reproduction systems, and relates more particu- 
larly to features that improve color matching between 
original color images and reproductions of those imag- 
es. 

BACKGROUND ART 
Overview 

[0002] Color image reproduction systems typically in- 
clude an input device for obtaining a representation of 
an original image, an output device for generating a rep- 
lica of the image, and a controlling device that processes 
signals received from the input device to generate new 
signals sent to the output device to produce the replica, 
which preferably is a high-fidelity reproduction of the 
original image. The controlling device may be imple- 
mented by a general-purpose computer with appropri- 
ate software and/or hardware for peripheral control and 
signal processing. Examples of an input device include 
hand held, flatbed and sheet-fed optical scanners, dig- 
ital and video cameras, and software applications. In 
other words, an original image may be sensed or it may 
be created by a process. Examples of an output device 
include ink jet, laser and photolithography printers, elec- 
trostatic, flatbed and drum plotters, and video displays 
such as cathode ray tubes, thin-film-transistor and liquid 
crystal display panels. 

[0003] Generally, input and output devices use some 
device dependent color-coordinate system to specify 
colors. These coordinate systems are often specified in 
some device-dependent color space that conveniently 
maps the color coordinates to the color-sensing or cofor- 
generating process of the particular device. The term 
"color space" refers to an A/-dimensional space in which 
each point corresponds to a particular color. 
[0004] One example of a three-dimensional color 
space is an RGB space in which point coordinates spec- 
ify particular amounts of red (R), green (G) and blue (B) 
colorant that addittvely combine to represent a specific 
color. The operation of many scanners and color display 
devices may be conveniently controlled by signals that 
are specified in RGB space. An example of a four-di- 
mensional color space is a CMYK color space in which 
point coordinates specify particular amounts of cyan 
(C), magenta (M), yellow (Y) and black (K) colorant that 
subtractively combine to represent a specific color. An- 
other example is the three-dimensional CMY color 
space. The operation of many ink jet and laser printers 
may be conveniently controlled by signals that are spec- 
ified in CMYK spacer or CMY space. Other color spaces 
that are related to particular devices are also known 
[0005] Many practical devices are capable of sensing 



or reproducing only a portion of the full range of colors 
that can be discerned by a human observer A device 
"gamut" refers to the range of colors that can be sensed 
or reproduced by a particular device. For example, the 

5 gamut of a particular scanner refers to the range of 
colors that can be sensed by that scanner and the gamut 
of a particular printer refers to the range of colors that 
can be reproduced or printed by that printer. 
[0006] A scanner gamut is determined by a variety of 

10 factors including the spectral response of the optical 
sensors, the spectral characteristics of color filters, 
spectral characteristics of the illumination source and 
the resolution and linearity of analog-to-digital convert- 
ers. 

is [0007] A printer gamut is determined by a variety of 
factors including spectral characteristics of colorants 
such as ink, spectral and porosity characteristics of me- 
dia such as paper, resolution or dots-per-inch of the 
printed image, half-toning methods and use of dithering, 

20 \\ any. 

[0008] A video display gamut is determined by a va- 
riety of factors including spectral characteristics of the 
light emitting material, type of display device, resolution 
of pixels or video lines, and excitation voltage. 

25 [0009] Although it is possible in principle to construct 
a color image reproduction system by merely connect- 
ing an output device directly to an input device, the re- 
sults generally would not be satisfactory because the 
device-dependent coordinate systems and color spaces 

30 for the input and output devices are generally not the 
same. Even if the two sets of coordinate systems and 
color spaces are the same, the fidelity of the reproduced 
image as compared to an original image would probably 
be very poor because the gamut of the input device gen- 

35 eralty is not co-extensive with the gamut of the output 
device. Values representing "out-of-gamut" colors that 
are not in the output device gamut cannot be reproduced 
exactly. Instead, some "in-gamut" color that is in the 
gamut of the output device must be substituted for each 

40 out-of-gamut color. 

[0010] Color image reproduction systems can 
achieve high-fidelity reproductions of original images by 
applying one or more transformations or mapping func- 
tions to convert point coordinates in one color space into 

45 appropriate point coordinates in another color space. 
These transformations may be conveniently performed 
by the controlling device, mentioned above. In particu- 
lar, with respect to the output device gamut, transforma- 
tions are used to convert values representing in-gamut 

50 and out-of-gamut colors in an input-device-dependent 
color space (DDCS) into values representing in-gamut 
colors in an output-DDCS. The mapping of in-gamut 
colors and out-of-gamut colors is discussed separately. 

55 Mapping In-Gamut Colors 

[0011] The transformation of output device in-gamut 
colors for many practical devices are non-linear and 
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cannot be easily expressed in some analytical or closed 
form; therefore, practical considerations make accurate 
implementations difficult to achieve. Many known meth- 
ods implement these transformations as an interpola- 
tion of entries in a look-up table (LUT) derived by a proc- 
ess that essentially inverts relationships between device 
responses to known input values. For example, a trans- 
formation for an input device may be derived by using 
a medium conveying patches of known color values in 
some device-independent color space (DICS) such as 
the Commission I nternationalde L'Eclairage (CIE) 1931 
XYZ space, scanning the medium with the input device 
to generate a set of corresponding values in some input- 
DDCS such as RGB color space, and constructing an 
input LUT comprising table entries that associate the 
known color XYZ values with the scanned RGB values. 
I n subsequent scans of other images, scanned RG B val- 
ues can be converted into device-independent XYZ val- 
ues by finding entries in the input LUT having RGB val- 
ues that are close to the scanned values and then inter- 
polating between the associated XYZ values in those 
table entries. Various interpolation techniques such as 
trilinear, prism, pyramidal and tetrahedral interpolation 
may be used. 

[001 2] Similarly, a transformation for an output device 
may be derived by producing a medium with color patch- 
es in response to color values selected from some out- 
put-DDCS such as CMYK color space, determining the 
color value of the patches in a DICS such as CIE XYZ 
space by measuring the patches using a spectral pho- 
tometer, and constructing an output LUT comprising ta- 
ble entries that associate the measured color XYZ val- 
ues with the corresponding CMYK values. In subse- 
quent output operations, XYZ color values can be con- 
verted into device-dependent CMYK values by finding 
entries in the output LUT having XYZ values that are 
close to the desired values and then interpolating be- 
tween associated CMYK values in those table entries. 
Various interpolations such as those mentioned above 
may be used. 

[0013] In operation, a color image reproduction sys- 
tem scans an original image to obtained scanned value 
in some input-DDCS, transforms the scanned values in- 
to some DjCS, transforms these device-independent 
values from the DICS into some output DDCS and, in 
response, generates a replica of the original image. As 
mentioned above, the transformations described thus 
far apply only to output device in-gamut colors. 

Mapping Out-of Gamut Colors 

[0014] By definition, output device out-of-gamut 
colors cannot be reproduced exactly. Instead, high- 
quality color image reproduction systems use trans- 
forms or mapping functions that substitute an in-gamut 
color for each out-of-garnut color. Preferably, these 
transforms attempt to minimize the perceptible differ- 
ence between each out-of-gamut color and the corre- 



sponding substitute in-gamut color. 
[0015] Techniques for transforming out-of-gamut 
colors into in-gamut colors generally map the out-of- 
gamut colors to the boundary of the output device gamut 
or compress a region of color space so that all desired 
colors are mapped into the output device -gamut. U.S. 
patent 5,185,661 describes a technique which seeks to 
preserve the hue of out-of-gamut colors. The technique 
disclosed in U.S. patent 5,450,216 seeks to minimize 
perceptible changes in luminance or chrominance. U.S. 
patent 5,491 ,568 discloses a technique that projects 
out-of-gamut colors onto the gamut boundary along a 
line orthogonal to a gray line in color space. In U.S. pat- 
ent 5,692,071, a disclosed technique maps each out-of- 
gamut color to the closest entry in a LUT. The technique 
disclosed in U.S. patent 5,712,925 divides the output 
device gamut into a higher-fidelity region and a lower- 
fidelity region and compresses all color space outside 
the higher-fidelity region into the lower-fidelity region. 

DISCLOSURE OF INVENTION 

[0016] It is an object of the present invention to pro- 
vide a degree of device and medium independence by 
separately accounting for differences in luminance dy- 
namic range of various devices and differences in me- 
dium spectral characteristics known as the white point. 
[0017] According to the teachings of one aspect of the 
present invention, color space transformations are de- 
rived for a color image reproduction system comprising 
an input device and an output device by obtaining a first 
transformation for the input device that maps from colors 
within an input-device-dependent color space to colors 
within a first device-independent color space, and ob- 
taining a normalization transformation that normalizes 
information obtained from the first transformation with 
respect to a white point in a second device-independent 
color space. 

[0018] According to the teachings of another aspect 
40 of the present invention, a transformation compresses 
luminance levels of values in an input-device gamut into 
a range of luminance levels within an output-device 
gamut. 

[0019] The various features of the present invention 
45 and its preferred embodiments may be better under- 
stood by referring to the following discussion and the 
accompanying drawings in which like reference numer- 
als refer to like elements in the several figures. The con- 
tents of the following discussion and the drawings are 
50 set forth as examples only and should not be understood 
to represent limitations upon the scope of the present 
invention. 

BRIEF DESCRIPTION OF DRAWINGS 

55 

[0020] Fig. 1 illustrates major components in a typical 
color image reproduction system. 

[0021] Figs. 2A and 2B illustrate major components 
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for deriving transformations for input and output devic- 
es, 

[0022] Figs. 3Aand 3Bare schematic representations 
of points and regions in color spaces, particularly corre- 
sponding points and regions in CIE XYZ space and CIE 
L*a*b* space. 

[0023] Fig. 4 is a schematic representation of two hy- 
pothetical gamuts within a two-dimensional projection 
of a normalized color space. 

[0024] Figs. 5Aand 5Bare schematic representations 
of points and hypothetical gamut boundaries in CIE 
L*a*b* space. 

[0025] Figs. 6Aand 6Bare schematic representations 
of points and transformational mappings onto the 
boundary of a hypothetical gamut in CIE L*a*b* space. 
[0026] Fig. 7 is a schematic representation of respec- 
tive gamuts for two printers or, alternatively, one printer 
operating in two different modes. 

[0027] Fig. 8 is a schematic representation of a shift 
in the gamut of a hypothetical printer such as that 
caused by component aging, for example. 
[0028] Fig. 9 illustrates major components in one em- 
bodiment of a controlling device that achieves an im- 
proved degree of device and media independence. 
[0029] Fig. 10 illustrates major components in a color 
image reproduction system that provides recalibration 
of selected colors for an output device. 
[0030] Fig. 11 illustrates one embodiment of a recali- 
bration transformation. 

[0031] Fig 12 illustrates major components in a typi- 
cal personal computer that may be used to implement 
various aspects of the present invention. 
[0032] Figs. 1 3A through 1 3C illustrate the end-to-end 
effects of input or output devices and the system com- 
ponents that implement device transformations. 
[0033] Fig. 14 is flowchart illustrating one method for 
deriving a transformation to overcome tone inversion. 
[0034] Fig. 15 illustrates major components for deriv- 
ing a transformation to overcome tone inversion. 
[0035] Fig. 16 is flowchart illustrating one method for 
improving the accuracy of a transformation for in-gamut 
colors. 

[0036] Fig. 17 is flowchart illustrating one method for 
improving the accuracy of a transformation for oul-of- 
gamut colors. 

[0037] Fig. 18 is flowchart illustrating one method for 
deriving a recalibration transformation. 
[0038] Fig. 19 is a flowchart illustrating one method 
for using a recalibration transformation. 

MODES FOR CARRYING OUT THE INVENTION 

Color Image Reproduction System Overview 

[0039] Fig. 1 illustrates major components in a typical 
color image reproduction system. Input device 10 re- 
ceives form path 11 signals representing an original im- 
age and generates along path 12 an input-device-de- 



pendent representation of the original image. Control- 
ling device 20 receives this representation from path 12 
and, in response, generates along path 31 an output- 
device-dependent representation of the original image. 

5 Output device 30 receives this representation from path 
31 and, in response, generates along path 32 a replica 
of the original image. The present invention is directed 
toward improving the fidelity with which the replica re- 
produces the original image. 

10 [0040] Input device 10 may be essentially any type of 
scanner, camera or digital graphics application. If input 
device 1 0 is an optical scanner, for example, the signals 
received from path 1 1 could be considered to be optical. 
If input device 10 is an application for creating ormanip- 

is ulating color images, for example, the signals received 
from path 11 could be considered to represent com- 
mands or data. Throughout this disclosure, more partic- 
ular mention will be made of optical scanners; however, 
many of the principles and features of the present in- 
20 vention may be applied in systems incorporating other 
types of input devices. 

[0041] Output device 30 may be essentially any type 
of printer, plotter or display. If output device 30 is an ink- 
jet printer, for example, the replica generated along path 

25 32 could be considered to be the printed image. If output 
device 30 is a CRT or TFT display, for example, the rep- 
lica generated along path 32 could be considered to rep- 
resent the image formed on the display device. 
Throughout this disclosure, more particular mention will 

30 be made of printers; however, many of the principles and 
features of the present invention may be applied in sys- 
tems incorporating other types of output devices. 
[0042] By its very nature, the characteristics of the in- 
put-device-dependent representation generated along 

35 path 1 2 depends on the characteristics of input devised 
10. Many optical scanners, for example, generate sig- 
nals representing colors as points with red (R), green 
(G) and blue (B) coordinates in an RGB device-depend- 
ent color space (DDCS). For ease of discussion herein, 

40 the input-DDCS will generally be referred to as RGB 
space; however, many other color spaces and represen- 
tations may be used to practice the present invention. 
[0043] Similarly, the characteristics of the output-de- 
vice-dependent representation generated along path 31 

45 are chosen to match the characteristics ol output device 
30. Many color printers, for example, generate images 
in response to values representing cyan (C), magenta 
(M), yellow (Y) and block (K) coordinates in a CMYK DD- 
CS. Many display devices such as cathode ray tubes or 

50 thin-film-transistor panels generate images in response 
to values representing red, green and blue in an RGB 
DDCS. Because of the device-dependent nature of 
these color spaces, scanner RGB spaces should not be 
equated to display RGB spaces. For ease of discussion 

55 herein, the output-DDCS will generally be referred to as 
CMYK space; however, many other color spaces and 
representations may be used to practice the present in- 
vention. 



4 



BNSDOCID: <EP 0948194A2_I_> 



7 



EP 0 948 194 A2 



8 



[0044] Controlling device 20 is responsible for trans- 
forming signals representing the original image in the 
input-DDCS into signals representing the same image 
in the output-DDCS. This may be accomplished by us- 
ing input-device map 21 to transform the input-DDCS 
signals into a representation in a device-independent 
color space (DICS), and using output-device map 23 to 
transform the DICS representation into the signals rep- 
resenting the same image in the output-DDCS. Control- 
ling device 20 may include other transformations and 
processes such as those described herein. 
[0045] Controlling device 20 may be implemented by 
software and/or hardware in a general-purpose compu- 
ter such as that illustrated in Fig. 12. Fig. 12 is a func- 
tional block diagram of one embodiment of a typical per- 
sonal computer system 40. CPU 42 provides computing 
resources. I/O control 43 represents an interface to I/O 
device 44 such as a keyboard, mouse or modem. RAM 

45 is system random access memory. Storage control 

46 represents an interface to storage device 47 that in- 
cludes a storage medium such as magnetic tape or disk, 
or an optical medium. The storage medium may be used 
to record programs of instructions for operating sys- 
tems, utilities and applications, and may include embod- 
iments of programs that implement various aspects of 
the present invention. Display control 48 provides an in- 
terface to display device 49. Control 50 represents an 
interface to scanner 51 which is an input device like an 
optical scanner Control 52 represents an interface to 
printer 53 which is an output device like an ink jet color 
printer. Devices like scanner 51 may serve as input de- 
vice 10 and devices like display device 49 or printer 53 
may serve as output device 30. 

[0046] In the embodiment shown, all major system 
components connect to bus 41 which may represent 
more than one physical bus. For example, some per- 
sonal computers incorporate only a so called Industry 
Standard Architecture (ISA) bus. Other computers in- 
corporate an ISA bus as well as a higher bandwidth bus 
conforming to some bus standard such as the VESA lo- 
cal bus standard or the PCI local bus standard. Prefer- 
ably, display control 48 connects to a high-bandwidth 
bus to improve the speed of display. A bus architecture 
is not required to practice the present invention. 
[0047] The functions of one or more computer com- 
ponents as well as various aspects of the present inven- 
tion can be implemented in a wide variety of ways in- 
cluding discrete logic components, one or more ASICs 
and/or program-controlled processors. 
[0048] Controlling device 20 may also be implement- 
ed by a special-purpose device. The manner in which 
controlling device 20 is implemented is not important to 
the present invention. For example, the following disclo- 
sure will sometimes refer to implementations that store 
tables in RAM merely for ease of discussion. Other im- 
plementations including digital and analog processing 
circuitry may used. 



Derivation of Input and Output Maps 

[0049] Fig. 2A and 2B illustrate major components for 
deriving input-device map 21 and output-device map 23. 
5 These illustrations and the following discussion are pre- 
sented merely as examples to illustrate principles. 
These maps or transformations may be derived in other 
ways. 

[0050] Referring to Fig. 2A, input-device map 21 may 
io be derived by scanning an image 15 that has known 
color characteristics. For example, image 15 may be 
one or more sheets of paper with areas or "patches" of 
known color. The color characteristics of these patches 
may be determined by measure device 60 such as a 

15 spectral photometer or colorimeter. According to the 
technique shown in the Figure, measure device 60 
scans image 15 and generates signals along path 61 
representing the colors of the patches in some DICS 
such as the Commission International de L'Eclairage 

20 (CIE) 1931 XYZ space, referred to herein as CIE XYZ 
space. Input device 10 scans image 15 and generates 
signals along path 12 representing the colors of the 
patches in an input-DDCS such as scanner RGB space. 
[0051] The device-independent and the device-de- 

25 pendent representations generated along paths 61 and 
12, respectively, provide selected points in the two color 
spaces that define a forward function /, representing the 
way in which input device 10 converts real-world colors 
into a device-dependent representation. In response to 

30 these signals, calibration device 65 derives input-device 
map 21 which is an inverse function /f 1 from the DCCS 
to the DICS. For example, if measure device 60 gener- 
ates values in CIE XYZ space and input device 10 gen- 
erates signals in some RGB space, then the forward 

35 function corresponding to input device 10 may be de- 
noted as /,: = XYZ-> RGB and the inverse function cor- 
responding to input-device map 21 may be denoted as 
/,-">: RGB -> XYZ. 

[0052] The way in which these two components work 

40 together is illustrated in Fig. 13A. Input device 10 effects 
a transformation /, on values representing real-world 
colors to obtain values in some input-DDCS. It is often 
convenient to represent real-world colors in some DICS 
such as CIE XYZ space. The transformation may then 

45 be expressed as a mapping from CIE XYZ space to 
some input-DDCS such as an RGB space as described 
above. Input-device map 21 effects a transformation/,' 1 
on the values in the input-DDCS to obtain mapped val- 
ues in some DICS such as CIE XYZ space. The end-to- 

50 end effects of these two components is to effect a trans- 
formation from one DICS to another DICS. According to 
the example discussed above and illustrated in the fig- 
ure, the transformation is, in principle, similar to the 
identity matrix that maps from CIE XYZ space to CIE 

55 XYZ space, which may be denoted as F,: XYZ XYZ. 
In practice, however, arithmetic roundoff errors and in- 
terpolation errors introduce noise into the process 
[0053] Referring to Fig. 2B, output-device map 23 
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may be derived by using output device 30 to generate 
image 35 and determining the color characteristics of 
image 35. For example, image 35 may be one or more 
sheets of paper with patches that are analyzed by meas- 
ure device 62 such as a spectral photometer or color- 
imeter. According to the technique shown in the figure, 
measure device 62 scans image 35 and generates sig- 
nals along path 63 representing the colors of the patch- 
es in some DICS such as CIE XYZ or CIE L*a*b* space. 
Output device 30 or some component controlling output 
device 30 generates signals along path 33 representing 
the patches in some output-DDCS such as printer 
CMYK space. 

[0054] The device-independent and the device-de- 
pendent representations generated along paths 63 and 
33, respectively, provide selected points ijn the two color 
spaces that define a forward function f Q representing 
the way in which output device 30 converts the device- 
dependent representation into real-world colors. In re- 
sponse to ihese signals, calibration device 67 derives 
output-device map 23 which is an inverse function f 0 ^ 
from the DICS to the DDCS. For example, if measure 
device 62 generates values in CIE L*a*b* space and 
output device 30 generates the image in response to 
signals in some CMYK space, then the forward function 
corresponding to output device 30 may be denoted as 
f Q : CMYK — > L*a*b* and the inverse function corre- 
sponding to output-device map 23 may be denoted as 
/o' 1 : L*a*b* -> CMYK. 

[0055] The way in which these two components work 
together is illustrated in Fig. 1 3B. Output-device map 23 
effects a transformation on values representing 
colors in some DICS to obtain values in some output- 
DDCS. Output device 30 effects a transformation /, on 
the values in the output-DDCS to obtain a replica image 
with real-world colors. If the real-world colors are ex- 
pressed in some DICS such as CIE XYZ space, the 
transformation may then be expressed as a mapping 
from the output-DDCS to CIE XYZ as described above. 
The end-to-end effects of these two components is to 
effect a transformation from one DICS to another DICS. 
According to the example discussed above and illustrat- 
ed in the figure, the transformation maps from CIE 
L*a*b* space to CIE XYZ space, which may be denoted 
as F c : L*a*b* -> XYZ. 

[0056] Figs. 3A and 3B are schematic representations 
of points and regions in two color spaces. These figures 
illustrate corresponding points and regions in CIE XYZ 
space and CIE L*a*b* space, discussed more fully be- 
low; however, these figures are useful to illustrate prin- 
ciples of a mapping relationship between arbitrary color 
spaces. As show in the figures, points 101 to 104 in one 
color space correspond to points 111 to 1 1 4, respective- 
ly, in another color space. The points along the four 
straight-line segments connecting these references 
points in the color space of Fig. 3A space correspond to 
points along the curved and straight-line segments con- 
necting the referenced points in the color space of Fig. 



3B. 

[0057] As these figures show, the correspondence is 
often non-linear. Because the transformation between 
color spaces usually cannot be expressed in a closed 
5 or analytical form, these transformations are often im- 
plemented by a look-up table, from which values of in- 
termediate points may be obtained by interpolation. 
[0058] For reasons that are discussed below, pre- 
ferred embodiments of systems incorporating scanners 
io and printers use two DICS. Scanner signals are mapped 
into CIE XYZ space and printer signals are mapped from 
CIE L*a*b* space. It is, therefore, necessary to provide 
a map or transformation from CIE XYZ to CIE L*a*b* 
space. This transformation may be denoted f T : XYZ 
'5 L*a*b*. As mentioned above, this transformation is illus- 
trated in Figs. 3A and 3B. In such embodiments, con- 
trolling device 20 converts signals received from path 
12 into signals generated along path 31 according to a 
transformation f c that is equivalent to a cascaded appli- 
20 cation of the transformations discussed above, denoted 
here as f c = f l -\f r f Q -\ or / c : RGB CMYK = 
RGB -* XYZ-/t XYZ -» L*a*b*»/o' 1 : L*a*b* -» CMYK. 
[0059] . The effect of this transformation in conjunction 
with the other transformations is illustrated in Fig. 13C. 
25 As explained above, input device 10 and input-device 
map 21 effect a transformation from one DICS to anoth- 
er DICS such as from CIE XYZ space to CIE XYZ space, 
denoted as F ( : XYZ -> XYZ. Output-device map 23 and 
output device 30 effect a transformation from one DICS 
30 to another DICS such as from CIE L*a*b* space to CIE 
XYZ space, denoted as F 0 : L*a*b* -> XYZ. By effecting 
a transformation from CIE XYZ space to CIE L*a*b* 
space, the / T transformation provides the link required 
to couple the F ( and the F Q transformations together. 
35 [0060] The end-to-end effect of these coupled trans- 
formations represents the overall operation of the color 
image reproduction system. According to the example 
discussed above and illustrated in the figure, this end- 
to-end effect is a mapping F s from CID XYZ space to 
*o CIE XYZ space which is, as mentioned above, equiva- 
lent in principle to an identity matrix. In absence of arith- 
metic round off errors and accuracy errors in the com- 
ponent transformations, the color image reproduction 
system is a transparent system that is able to reproduce 
45 an original image perfectly. 

[0061] Unfortunately, even if the transformations 
could be implemented perfectly, reproduction errors still 
occur because practical input and output devices have 
limited gamuts that are generally not coextensive. As a 
so result, the perceived accuracy of the replica depends on 
the ability of the system to substitute an in-gamut color 
that is indistinguishable from each out-of-gamut color. 
This process is sometimes referred to as gamut map- 
ping. 

ss 

Gamut Mapping 

[0062] As mentioned above, input and output devices 
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are capable of sensing or reproducing only a portion of 
the full range of colors that can be discerned by a human 
observer. The "gamut" of a scanner, for example, refers 
to the range of colors that can be sensed by that scan- 
ner. The gamut of a printer refers to the colors that can 
be generated by that printer. The colors that can be re- 
produced are referred to as "in gamut" colors and the 
colors that cannot be reproduced are referred to as "out- 
of-gamut" colors. 

[0063] Fig. 4 is a schematic representation of two hy- 
pothetical device gamuts. Closed contour 120 repre- 
sents a two-dimensional projection of a normalized color 
space, such as the CIE xy chromaticity diagram, that 
represents the chromaticity of the visible spectrum. 
Colors are plotted in the diagram according to wave- 
length. The shortest wavelengths appear in the lower- 
left region within contour 120 and the longest wave- 
lengths appear in the lower-right region within contour 
120. 

[0064] The triangle with vertices at points 121 to 123 
represents a device gamut that is typically represented 
in an RGB space; however, as shown, the boundary of 
this gamut is plotted in CIE xy space. Vertex 121 repre- 
sents the extent to which the gamut includes colors in 
the red portion of the spectrum. The vertices at points 
122 and 123 represent the extent to which this gamut 
includes colors in the green and blue portions of the 
spectrum, respectively Ignoring granularity due to the 
discrete nature of digital devices, a device having this 
gamut is capable of reproducing all of the colors inside 
this triangle. 

[0065] Similarly, the polygon with three of its vertices 
at points 126 to 128 represents a device gamut that is 
typically represented in CMY space; however, as 
shown, the boundary of this gamut is plotted in CIE xy 
space. The vertices at points 1 26 to 1 28 correspond to 
colors in the cyan, magenta and yellow portions of the 
spectrum, respectively. Ignoring granularity due to dig- 
ital implementations, a device having this gamut is ca- 
pable of reproducing all colors included within the poly- 
gon. 

[0066] Figs. 5A and 5B are schematic representations 
of points and hypothetical gamut boundaries in CIE 
L*a*b* space. The L* coordinate represents luminance 
or brightness and the a\b* coordinates represent color. 
Points having the same L* coordinate have the same 
luminance and points having the same angle with re- 
spect to the a*,b* axes have the same color or hue. The 
distance between a point and the L* axis is a measure 
of chroma magnitude or chromaticity. Points along the 
L* axis represent shades of gray from black to white 
which are neutral in color. 

[0067] Fig. 5A illustrates two hypothetical gamuts 1 31 
and 1 33 in L*a*b* color space as viewed along the L* 
axis. Fig. 5B illustrates gamuts 131 and 133 as viewed 
along the b* axis. The gamut boundaries shown in Fig. 
5A as well as in other figures are intended to provide 
simple illustrations suitable for understanding principles 



of the present invention. They are not intended to rep- 
resent the boundaries of gamuts for actual devices 
which are generally more complex. 
[0068] Circles 1 31 and 1 33 shown in Fig. 5A illustrate 

5 the locus of points in plane 1 30 at the boundaries of the 
two gamuts. Point 134 is inside gamut 131 but outside 
gamut 133. Point 136 is inside both gamuts. As may be 
seen from the two figures, gamut 1 31 includes a greater 
range of colors and luminance than does gamut 133. 

io The gamut of a typical scanner often includes a greater 
range of colors than does the gamut of a typical printer. 
It is not uncommon, however, for a printer gamut to in- 
clude some colors that are outside a scanner gamut. 
This situation poses no difficulty because the scanner 

*5 inherently maps such colors into its own gamut. 

Mapping In-Gamut Colors 

[0069] As mentioned above, transformations from a 

20 first color space to a second color space are often non- 
linear and usually difficult if not impossible to express in 
some closed or analytical form. These transformations 
are generally implemented by an approximation tech- 
nique such as multidimensional interpolation of entries 

25 in a LUT Each entry in the LUT contains coordinates of 
a specific point in the first color space and coordinates 
of the corresponding point in the second color space. 
For any arbitrary point in the first color space, the coor- 
dinates of the corresponding point in the second color 

30 space can be approximated by interpolating coordinates 
of selected table entries. Trilinear, prism, pyramidal and 
tetrahedral interpolation techniques and a number var- 
iations of such techniques are known; however, some 
form of tetrahedral interpolation is generally preferred. 

35 [0070] According to tetrahedral interpolation, the LUT 
is searched to find entries representing points in the first 
color space that define the vertices of the smallest tet- 
rahedron that encloses the arbitrary point. Interpolation 
coefficients are calculated based on the relative position 

40 of the arbitrary point with respect to the four vertices. 
Finally, an approximation of the mapped point is ob- 
tained by using the interpolation coefficients to form a 
linear combination of the coordinates in the second color 
space that correspond to the four vertices. This linear 

4 $ combination may be represented as: 

Xp = a^ x.j +■ 3gX2 + ci^Xg + a 4 x 4 

so 

y P =a l y 1 +a 2 y 2+ a 3 y 3 +a 4 y 4 
z p =a 1 z l +a 2 z 2 +a 3 z 3 + a 4 z 4 

55 

where x P = the point in second color space correspond- 
ing to the arbitrary point, 
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a-, through a 4 are the coefficients of interpolation, 
(Xi.y^z-i) = coordinates of vertex 1 in the second 
color space, 

(x 2t y 2 ,z 2 ) = coordinates of vertex 2 in the second 
color space, 

(X3.y3.Z3) = coordinates of vertex 3 in the second 
color space, and 

(X4,y 4 ,z 4 ) = coordinates of vertex 4 in the second 
color space. 

[0071] Additional information regarding various forms 
of interpolation may be obtained from H.R. Kang, "Color 
Technology for Electronic Imaging Devices," SPIE Op- 
tical Engineering Press, 1997 ; pp. 64-101, 141-152 and 
248-251, which is incorporated herein by reference. 

Mapping Out-of -Gamut Colors to Gamut Boundary 

[0072] In preferred embodiments, out-of-gamut 
colors are mapped onto the boundary of the gamut by 
projecting the color onto the line in color space repre- 
senting neutral (gray) colors and clipping the projection 
at the gamut boundary. This can be performed conven- 
iently in CIE L*a*b* space where points on the L* axis 
represent neutral colors. 

[0073] Referring to Fig. 6A, the out-of-gamut color 
represented by point 134 is mapped to the color repre- 
sented by point 135 on the gamut boundary by project- 
ing a line from point 134 to the L* axis and finding the 
intersection of the projection with the boundary. If pos- 
sible, the projection is orthogonal to the L* axis so that 
the luminance level is preserved. 
[0074] An orthogonal projection to the L* axis is not 
always possible. Referring to Fig. 6B, the colors repre- 
sented by points 141 and 144 have luminance levels 
that lie outside the gamut. The projection from point 141 
is made to point 1 42, which represents the minimum val- 
ue for L* in the gamut along the neutral-color line. The 
projection from point 144 is made to point 145, which 
represents the maximum value for L* in the gamut along 
the neutral-color line. 

[0075] This mapping may be performed in other color 
spaces. For example, in CIE XYZ space, the points of 
neutral color define a line for which x/x 0 = y/y 0 = z/z 0 , 
where (x 0 ,y 0 ,z 0 ) specifies normalization coordinates for 
the color space. An out-of-gamut color may be mapped 
to the intersection of the gamut boundary with a curve 
connecting the point to this line. The curve corresponds 
to the orthogonal projection in L*a*b* space that pre- 
serves luminance. Alternatively, a straight-line projec- 
tion or some other curve can be used in XYZ space, 
which will provide a different result. 

Extending the Color Range for the Input-Device Gamut 

[0076] The accuracy of input-device map 21 provided 
by a technique such as that illustrated in Fig. 2A is en- 
hanced if the range of colors conveyed by image 15 is 



at least as broad as the gamut of input device 10. In 
other words, it is very likely that the accuracy of input- 
device map 21 will be very poor in those regions of color 
space that are not represented by any patches in image 
5 15. This poor accuracy can cause an input-device trans- 
formation to map colors in a way that does not preserve 
relative chroma magnitudes. 

[0077] Referring to Fig 7, point 165 represents an 
out-of-gamut color that has a chroma magnitude greater 

10 than the chroma magnitude of an in-gamut color repre- 
sented by point 155. If input-device map 21 is derived 
from only the colors available from gamut 150, then a 
color represented by a point such as point 165 will be 
mapped by interpolation to point 167 inside the bound- 

15 ary of gamut 150. The color will be mapped inside the 
gamut boundary because the four points defining the 
smallest tetrahedron that encloses point 165 are all on 
the gamut boundary. In other words, because input-de- 
vice map 21 is formed from only colors found within 

20 gamut 1 50, there are no points outside the gamut to pro- 
vide a vertex for interpolation. The extent to which a 
point representing an out-of-gamut color is mapped to 
a point inside the boundary will depend on the accuracy 
and resolution of the interpolation points and the con- 

25 vexity of the local gamut boundary. If the accuracy of the 
input-device transformation is sufficiently poor or the 
convexity of the local gamut boundary is sufficiently 
large, the chroma magnitude of the color represented 
by point 1 67 may be less than the chroma magnitude of 

30 the color represented by point 155 This result may be 
perceived as an inversion of chromaticity, sometimes re- 
ferred to as tone inversion. 

[0078] Tone inversion may be avoided or at least re- 
duced by using a broader range of colors to derive the 

35 input-device map. One way to produce a broader range 
of colors is to use a printer or other output device with 
a very broad gamut to generate image 1 5. Such devices 
are usually expensive or difficult to acquire. 
[0079] Another way to produce a broader range of 

40 colors is to use multiple printers that have widely varying 
gamuts or to operate one or more printers in multiple 
modes. In this context, "mode" refers to a number of op- 
erating conditions including printing resolution (dpi), 
choice of colorants or media, and half-toning methods 

45 or stochastic screening techniques. 

[0080] Fig. 7 is a schematic representation of respec- 
tive gamuts 1 50 and 1 60 for two printers or, alternatively, 
one printer operating in two different modes. For ease 
of explanation, either or both of these situations are in- 

50 eluded in the following discussion that refers to gamuts 
of different printers. 

[0081] Fig. 14 illustrates one method for deriving an 
input-device map 21 to overcome tone inversion. First, 
using a technique similar to that described above, an 
55 inverse function py 1 is obtained (step S241) for the 
points in gamut 150 representing colors printed by the 
first printer Similarly, an inverse function g 2 ~* is obtained 
(step S242) for the points in gamut 160 representing 
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colors printed by the second printer. If a color is repre- 
sented by points in both gamuts (step S243) such as 
those represented by points 152 and 162, the inverse 
function ry 1 for input-device map 21 is equal to the av- 
erage of the inverse functions (step S244). The "same" $ 
color from two sets of patches will not necessarily be 
mapped by the input device to the same point in DDCS. 
The difference in mapped points may occur due to noise 
in the scanning process and/or because of minor differ- 
ences in the actual colors. w 
[0082] If a color is represented by a point in only gam- 
ut 150 (step S245) such as that represented by point 
1 51 , the inverse function A, -1 is equal to the inverse func- 
tion cy 1 obtained for that gamut (step S246). If a color 
is represented by a point in only gamut 160 (step S247) is 
such as that represented by point 1 66, the inverse func- 
tion f, -1 is equal to the inverse function p 2 _1 obtained for 
that gamut (step S248). If a color is represented by point 
that is in neither gamut such as the color represented 
by point 165, a projection is made to a line representing 20 
neutral colors (step S249) and the points and p 2 of 
intersection of that projection with the boundary of gam- 
ut 150 and 160, respectively, is determined (step S250). 
If the point of intersection p 1 with gamut 1 50 represents 
a color with a greater chroma magnitude than the point 25 
of intersection p 2 with gamut 160 (step S251 ), then point 
Pt is selected to be the mapped point (step S252). Oth- 
erwise, point p 2 is selected to be the mapped point (step 
S253). Alternatively, the point of intersection represent- 
ing the color with the largest magnitude chroma coordi- 30 
nate may be selected. 

[0083] In the example shown in Fig. 7. the projection 
from point 1 65 intersects the boundaries of the two gam- 
uts at points 166 (point p 2 ) and 167 (point p-, ). The color 
represented by point 166 has the larger chroma magni- 35 
tude, therefore, point 166 is selected to define the map- 
ping for the color represented by point 165. 
[0084] This relationship may be summarized as fol- 
lows: 

40 

r i " 1 (p)=1/2[p 1 " 1 (p) + g 2 ' 1 (p)] 
if p is in both gamut 1 and gamut 2; 

45 

fi~\p) = 0i" 1 (P) 
if p is in gamut 1 but not in gamut 2; 

so 

A/ 1 (p) = p 2 ' 1 (p) 
if p is in gamut 2 but not in gamut 1 ; 

55 

^ 1 " 1 (P) = P 1 " 1 (P 1 ) 



if p is in neither gamut 1 nor gamut 2 and the chro- 
ma of p 1 is greater than the chroma of p 2 ; and 

V 1 (P)= p," 1 (p 2 ) 

otherwise, 
where 

Pi = the intersection of a projection of point p onto 
the neutral-color line and the boundary of gamut 1 , 
and 

p 2 = the intersection of a projection of point p onto 
the neutral-color line and the boundary of gamut 2. 

[0085] Fig. 15 illustrates major components of one 
way for deriving a transformation in this manner Check 
gamuts 82 receives information from path 81 represent- 
ing one or more points in color space and determines 
whether a respective point p is in either or both of two 
gamuts. If point p is in the first gamut information rep- 
resenting that point is passed along path 83 to transfor- 
mation 91 which implements inverse function g^ 1 dis- 
cussed above. If point p is in the second gamut, infor- 
mation representing that point is passed along path 84 
to transformation 92 which implements inverse function 
g^ 1 discussed above. If point p is in both gamuts, infor- 
mation is passed to both transformations and an indica- 
tion of this is passed along path 85. If point p is in neither 
gamut, information representing that point is passed 
afong path 86. 

[0086] Projection/clip chroma 87 projects a line from 
point p to the neutral-color line, determines the intersec- 
tion or clip point p n of this projection with the boundary 
of the first gamut, and determines the chroma for point 
p v In one embodiment, the chroma is determined from 
the chroma magnitude which, in L*a*b* space, is equal 
to the square root of the sum of the squares of the a* 
and b* coordinates. In another embodiment, the chroma 
is determined from the magnitude of the largest coordi- 
nate which, in L*a*b* space is the larger of la*l and Ib*L 
Similarly, projection/clip chroma 88 projects a line from 
point p to the neutral-color line, determines the intersec- 
tion or clip point p 2 of this projection with the boundary 
of the second gamut, and determines the chroma for 
point p 2 . 

[0087] Compare 89 determines whether point or 
point p 2 has the larger chroma. If point p 1 has the larger 
chroma, compare 89 passes information representing 
point p! along path 83 to transformation 91 . If point p 2 
has the larger chroma, compare 89 passes information 
representing point p 2 along path 84 to transformation 
92. 

[0088] Select 93 receives the results of transforma- 
tion 91 and transformation 92 and, if the indication re- 
ceived from path 85 indicates point p is in both gamuts, 
generates along path 94 information representing the 
average of the results received from both transforma- 
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lions If the indication received from path 85 does not 
indicate point p is in both gamuts, select 93 generates 
along path 94 information representing the sum of the 
results received from both transformations. In this em- 
bodiment, it is assumed that if no information is passed s 
to a respective transformation, that transformation pro- 
duces a result equal to zero; therefore, the sum of the 
results will be equal to whichever transformation was 
passed information. 

[0089] This technique may be used with any number 10 
(/V>1) of gamuts by obtaining an inverse transformation 
for each gamut, determining whether a point p is in all 
of the gamuts and, if so, taking the average of the re- 
spective inverse transformations for each gamut. It the 
point is not in all gamuts, a check is made to determine '5 
if point p is in some combination of AM gamuts. II so, 
an average of the respective inverse transformations tor 
those AM gamuts is taken. If not, a check is made for 
all combinations of N-2 gamuts. This process continues 
until it is determined that point p is in none of the gamuts. 20 
A projection to the neutral-color line is made and a check 
is made to determine all intersections with various gam- 
ut boundaries. The intersection with the largest chroma 
magnitude, or alternatively the largest chroma coordi- 
nate, is selected and the appropriate inverse transfor- 25 
mation is taken of that point. 

Device and Media Independence 

[0090] In preferred embodiments, input-device map 30 
21 is independent of output device 30, output device 
map 23 is independent of input device 10, and both 
maps are independent of the media used by output de- 
vice 30 to generate the replica. Nevertheless, if a color 
image reproduction system uses multiple input devices, 35 
output devices and/or media types, considerable mem- 
ory is required to store the transformation LUT for each. 
The technique described below can reduce the amount 
of memory required to store LUT by eliminating the need 
for multiple transformations to accommodate media var- 40 
iations and by simplifying the process required to ac- 
commodate differences in the dynamic range of lumi- 
nance for various device gamuts. One embodiment of 
controlling device 20 that comprises components pro- 
viding these features is illustrated in Fig. 9. 45 
[0091] A degree of media independence may be 
achieved by normalize 24, which accounts for differenc- 
es in the "white point" for respective media. This may 
be accomplished conveniently in the f T transformation 
discussed above that converts values from CIE XYZ so 
space into CIE L*a*b* space. A point in XYZ space may 
be mapped into L*a*b* space by the following non-linear 
equations: 

L*^r 116m(y/y 0 ) - 16 55 



a* = 500[m(x/x 0 )-m(y/y 0 )] 

b*= 500[m(y/y 0 )- m (z/z 0 )] 

where x, y, z = coordinates in CIE XYZ space, 

*o. Vo> z o = maximum value for the coordinates in 
CIE XYZ space, 

m(\) = t 1 * if 0.008856 < t < 1 , and 

m(t) = 7.787t + (16/116) if 0 £ t < 0.008856 for the 

independent variable t. 

[0092] By varying the values of the x 0 ,y 0 ,z 0 coordi- 
nates, normalize 24 can normalize the XYZ space ac- 
cording to a desired medium "white point" as the map- 
ping into L*a*b* space is performed. As a result, varia- 
tions in media white point can be accommodated by an 
implementation that requires only enough memory to 
store one transformation LUT. 

[0093] The desired white point for a particular medium 
can be determined by scanning the medium and trans- 
forming the scanned values using an appropriate trans- 
formation such as input-device map 21; however, more 
accurate results may be obtained if the white point is 
determined by analyzing the medium with a spectral 
photometer. 

[0094] Normalize 24 can be made responsive to a va- 
riety of input. For example, normalize 24 may select nor- 
malization parameters from a table in response to a sig- 
nal received from path 1 3 such as that provided by a 
user activated switch or selected software option, or it 
may adapt normalization parameters in response to a 
white point measurement provided by input device 10 
and input-device map 21. The measurement may be 
taken during a special white-point calibration scan or 
possibly from an assessment of the predominant color 
in a scanned original image. 

[0095] A greater degree of device independence may 
be achieved by compress 25, which accounts for differ- 
ences in the range of luminance levels for input- and 
output-device gamuts. Referring to Fig. 5B, suppose 
gamut 1 31 represents a scanner gamut with a detecta- 
ble range of luminance levels form L* = 0 to 100, and 
gamut 1 33 represents a printer gamut with a reproduc- 
ible range of luminance levels form L* = 30 to 100. In 
the example shown, the two devices have the same up- 
per limit but have different lower limits. The technique 
discussed here may be applied to devices with respec- 
tive luminance ranges that differ in essentially any way 
[0096] As explained above, out-of-gamut colors such 
as the color represented by point 141 in Fig. 6B may be 
mapped to the minimum luminance level for a neutral 
color in the printer gamut. Alternatively, such colors may 
be mapped into the printer gamut by compressing the 
luminance level. In the example mentioned above, this 
could be accomplished by linear compression of lumi- 
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nance levels in the range from L* = 0 to 40 into the range 
from L* = 30 to 40. Luminance levels form L* = 40 to 1 00 
are unchanged. Essentially any form of compression 
may be used; however, linear compression of this type 
is inexpensive to perform, provides some gradation in s 
luminance level rather than merely clipping all low-level 
colors to the minimum, restricts changes in luminance 
to lower levels where changes are not easily perceived, 
and preserves luminance values at higher levels where 
changes are more easily perceived, and preserves lu- 10 
minance values at higher levels where changes are 
more easily perceived. 

[0097] Luminance compression can be provided eas- 
ily without requiring an elaborate transformation. As a 
result, luminance dynamic range variations in device- *5 
dependent gamuts can be accommodated and a degree 
of device independent can be achieved without requir- 
ing significant additional memory to store a LUT. 
[0098] This compression can be made responsive to 
a variety of input. Compress 25 may select compression 20 
parameters from a table in response to a signal received 
from path 14 such as that provided by a user activated 
switch or selected software option, or it may adapt the 
compression parameters in response to signals identi- 
fying an output device that are received from the output 25 
device itself. 

[0099] Preferably, after luminance compression, the 
resulting L*a*b* coordinates for each picture element 
(pixel) is compared to thresholds and, if the color space 
coordinates representing that pixel have a prescribed 30 
relationship with respect to those thresholds, the L*a*b* 
coordinates are set to some specified values, say 
(100,0,0). This may be represented by the following 
pseudo code fragment: 

35 

If L* > L TH and la*l < a TH and lbT< b-^ then 
set L* equal to 100 
set a* equal to 0 
set b* equal to 0 

40 

The thresholds may be specified as L TH = 95, a TH = 2 
and b TH = 3, for example. 

[0100] This process is represented by white point 
background 26 in Fig. 9. The specified values represent 
a desired white point for the output replica. This process 45 
tends to remove artifacts from the replica that are cre- 
ated by noise in the scanning process and by arithmetic 
round off errors in the transformation processes. This 
operation may also be used to remove the background 
color of the original medium without changing the colors so 
of the reproduced image. 

Improving Accuracy of an Input Device Map 

[0101] As mentioned above, transformations are of- ss 
ten implemented by an interpolation of entries in a look- 
up table (LUT). Because the transformations are non- 
linear, the accuracy of the interpolation is affected by the 



distance between points represented by adjacent en- 
tries in the table. 

[0102] As discussed above in connection with Figs. 
3A and 3B, a point can mapped from CIE XYZ space 
into CIE L*a*b* space by a set of analytical expressions. 
This type of transformation is not available for many 
color space mappings but it is useful to illustrate the ac- 
curacy of interpolation. 

[0103] Point 107 is shown in Fig. 3A to be within a 
tetrahedron that has vertices at points 101 to 104. By 
applying tetrahedral interpolation to corresponding 
points 111 to 1 1 4 in L*a*b* space according to the rela- 
tive position of point 107 with respect to the tetrahedral 
vertices, an approximate position can e obtained for the 
corresponding point in L*a*b* space. This approximate 
location is illustrated as point 1 1 8. By applying the three 
analytical expressions discussed above, an exact map- 
ping in L*a*b* space for point 1 07 can be obtained. This 
exact mapping is shown as point 117. The distance be- 
tween points 117 and 118 represents the interpolation 
error. 

[0104] One common method for improving the accu- 
racy of interpolation is to increase the density of the 
points represented in the LUT Although this solution is 
simple in concept, it is often impractical because of the 
increase in cost for the memory required to store the 
LUT 

[0105] The interpolation accuracy of an input-device 
map may be improved without increasing the number of 
LUT entries by modifying some of the points represent- 
ed in the LUT for selected regions of color space. One 
important region of color space that generally requires 
high accuracy is the region containing the points of neu- 
tral color. In some color spaces such as CIE L*a*b*. 
these points are coincident with the L* axis, or a*=b*=0. 
[01 06] The accuracy of interpolation for a selected re- 
gion of a mapped color space can be improved by ob- 
taining color patches for a selected color within the se- 
lected region, measuring the patch as necessary to ob- 
tain appropriate values in a DICS, scanning the patch 
to obtain appropriate values in the input-DDCS, and 
modifying entries in the LUT representing points adja- 
cent to the selected color. Patches of selected colors 
may be obtained by choosing points that are interior to 
each region of interest, mapping the points to the appro- 
priate output-DDCS, generating the appropriate patch- 
es. If the selected color is outside the gamut of a partic- 
ular output device, another output device may be used. 
[0107] The table entries corresponding to the four ver- 
tices are modified according to two different processes 
depending upon whether the region of interest is inside 
or outside the gamut. The process of improving accura- 
cy for regions inside the gamut will be discussed first. 

improving Accuracy of In-Gamut Colors 

[0108] In a preferred embodiment, the entries in the 
LUT correspond to uniformly spaced grid points in a 
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color space. Because it is difficult if not impossible to 
obtain color patches for specific grid points in the color 
space, the values for essentially all of the LUT entries 
are calculated by interpolation of the values that can be 
obtained from actual color patches. The perceptible ef- $ 
feet caused by the errors introduced by this process de- 
pend on a number of factors including the relative spac- 
ing of the color patches in the color space and the var- 
ying sensitivity of the human observer to changes in 
color across the color space. 10 
[0109] The accuracy of a LUT derived in this manner 
can be improved by obtaining a very large number of 
patches having colors represented by points closely 
spaced in the color space; however, this is usually im- 
practical. This technique overcomes this problem by de- is 
riving the LUT from a relatively small number of patches 
represented by colors widely separated in the color 
space and obtaining additional patches for selected in- 
gamut colors as required to improve the LUT accuracy 
in those regions of color space where transform accu- 20 
racy is more important. As mentioned above, one im- 
portant region contains the points of neutral color. 
[0110] For a LUT used fortetrahedral interpolation, an 
additional patch for a selected in-gamut color may be 
obtained by identifying an interior point of a tetrahedron 25 
having four vertices defined by points in the LUT. An in- 
terior point (x p ,y p ,2p) to a specific tetrahedron defined 
by vertices at points (x-, t y, .z., ) through (x 4 ,y 4l z 4 ) may be 
determined from the expressions: 

30 

Xp — a^x^ + a 2 x 2 + a 3 x 3 + a 4 x 4 



yp^a.y, + a 2 y 2 + a 3 y 3 + a 4 y 4 



z p = a, z, + a 2 z 2 + a 3 z 3 + a 4 z 4 

where a } through a 4 are coefficients of interpolation cho- 40 
sen such that a 1 +a 2 +a 3 +a 4 =1 and all the coefficients are 
greater than zero. 

[0111] Referring to Fig. 3A, suppose points 101 to 104 
represent vertices at points (x t ,y t t z A ) through (x 4 ,y 4 ,z 4 ) ( 
respectively. By setting the coefficients of interpolation 45 
appropriately, any point internal to the tetrahedron may 
be chosen. Point 107, for example, may be selected by 
choosing the interpolation coefficients appropriately. 
[01 12] The interpolation process used to derive a LUT 
entry from measured values is essentially the same so 
process as that used to implement the device trans- 
forms themselves. By obtaining additional color patches 
in selected regions of color space, the distance between 
the measured points in those regions is reduced and the 
accuracy of interpolation between these more closely ss 
spaced points is enhanced. As a result, the accuracy of 
the transform implemented by the LUT is also en- 
hanced. This process may be repeated until a desired 



level of transformation accuracy is achieved. 
[0113] Referring to Fig. 16, this process may be car- 
ried out by printing color patches that correspond to 
some set of points separated in color space by some 
suitably large distance (step S261) and deriving from 
these patches a LUT with uniform spacing (step S262). 
The tetrahedral regions formed by points in the LUT en- 
tries are examined to determine if the mapping error is 
unacceptable large (step S263). For any particular tet- 
rahedron, the mapping error may be determined by se- 
lecting an interior point of the tetrahedron, printing a cor- 
responding patch, measuring the actual color of the 
patch using a measuring device such as a spectral pho- 
tometer, and comparing the measured values with the 
values obtained by LUT interpolation. The way in which 
an interior point may be selected is described above. 
[0114] If no region has an unacceptably large error, 
the process terminates (step S264), otherwise a point 
interior to that tetrahedral region is selected and a cor- 
responding color patch is printed (step S265). The color 
patch is scanned (step S266) and the information in the 
LUT entries for the four points defining the tetrahedral 
region are derived again using the new color point (step 
S267). The color patch and scanned values used to de- 
termine the mapping error may also be used here. This 
process reiterates until no tetrahedral region represent- 
ed by LUT entries has interpolation errors that are un- 
acceptably large. 

Improving Accuracy for Out -of Gamut Colors 

[0115] The accuracy of LUT entries for out-of-gamut 
colors can be improved by obtaining additional patches 
for selected out-of-gamut colors as required to improve 
the LUT accuracy in those regions of color space where 
transform accuracy is more important. These patches 
may be obtained from another source such as a different 
output device or by operating a given output device in a 
different mode, as described above. The coordinates of 
the point in DICS representing the patch color may be 
obtained from a measuring device such as a spectral 
photometer. 

[0116] Referring to Fig. 17, a method for improving the 
accuracy of out-of-gamut colors comprises using cur- 
rent LUT entries to obtain an initial estimate of the patch 
color space coordinates (step S271), comparing the es- 
timated coordinates to the actual (measured) coordi- 
nates to obtain the estimation error (step S272), deter- 
mining if the estimation error is acceptably small (step 
S273) and, if not, modifying current LUT entries accord- 
ing to the estimation error (step S274). The process ter- 
minates (step S275) when the estimation error is ac- 
ceptably small. 

[0117] An initial estimate of the coordinates (x s ,y s ,z s ) 
in the DICS for a selected out-of-gamut color is obtained 
by tetrahedral interpolation of the four points closest to 
the scanned point according to: 
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a i M'> + a 2 X 2W + a 3 X 3 (') + a 4 X 4(') 



y s = a iyt + a 2 y 2 + a 3 y 3 + a 4 y 4 



V £ = a, V, (') + a 2 y 2 (i) + a 3 y 3 (i) + a 4 y 4 (i) 



WO 



>(') + a 3 2 3( j ) +a 4 2 4 (') 



where interpolation coefficients a A through a 4 are deter- 
mined by the location ot the interpolated point relative 
to the locations of these four closest points. 
[0118] The estimation errors in the x, y and z dimen- 
sions are obtained from the expressions: 



-x c 



V S 



15 



where the coordinates x m , y m and z m are known from 25 
measurements of the color patch. Alternatively, other 
measures of estimation error may be used such as the 
square of the differences shown above. 
[01 19] The coordinates of the four closest points are 
modified to obtain a lower estimation error. For example, 30 
the x coordinates are modified reiteratively according to 
the following expressions: 



^(0 = ^('-i)-n j^f 



3e„ 



35 



x 2 (/) = x 2 (/-l)-i1 



Be. 



x 3 (/) = x 3 (/-1Hi ^ 



40 



45 



where 



/= index of iteration, and 
t| = convergence coefficient. 

The y and z coordinates are modified in a similar man- 
ner. After each iteration, a new interpolation is per- 
formed according to 



so 



55 



and a new estimation error is obtained as explained 
above. The iteration continues until the estimation error 
is acceptably small. 

[0120] By using these two techniques, the interpola- 
tion accuracy of a LUT for both in-gamut and out-of- 
gamut colors may be improved without increasing the 
number of entries in the LUT 

Retaining Useful Information in Self-calibration 
Techniques — 

[0121] The operational characteristics of many input 
and output devices change with time. These changes 
cause shifts in the location and size of device gamuts in 
color space. Similar changes may occur as a result of 
operating an output device in a new mode or using dif- 
ferent media. As a result, it is desirable to modify trans- 
formations to account for these changes so that the re- 
production accuracy of a system can be maintained. 
The following technique accounts for changes in the 
gamut of output device 30 by deriving a recalibration 
transformation. 

[0122] Fig. 8 is a schematic representation of a shift 
in the gamut of a hypothetical output device such as that 
caused by component aging. Gamut 1 70 represents the 
original characteristics of output device 30 which was 
used originally to calibrate the color image reproduction 
system. The colors represented by points 171 and 173 
are in the original gamut and colors represented by 
points 185 and 188 are outside the original gamut. 
Points 185 and 188 are mapped onto the boundary of 
the original gamut at points 176 and 179, respectively. 
[0123] Gamut 180 represents current characteristics 
of output device 30 which is to be used to recalibrate the 
system. According to this new gamut, colors represent- 
ed by points 181 and 188 are in the current gamut and 
colors represented by points 173 and 185 are outside 
the current gamut. 

[0124] One way in which a system may be recalibrat- 
ed is to merely invoke the procedures described above, 
deriving new device maps in a manner similar to that 
done to derive original maps. This approach is not at- 
tractive because the derivation of an accurate map for 
an entire gamut can require considerable time and ex- 
pense and because it discards useful information that 
may not be available at the time of recalibration. For ex- 
ample, patches of a particular color that were used to 
derive an original device map may not be available at 
the time of recalibration. 
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[0125] The technique described below overcomes 
these problems by providing for self-recalibration and 
by restricting the recalibration to those regions of color 
space that are inside the current output device gamut. 
As a result, LUT entries for colors such as those repre- 
sented by points 181 and 188 are affected by the recal- 
ibration process but LUT entries for colors such as those 
represented by point 173 are not affected. 
[01 26] Referring to Figs. 1 0 and 1 8, controlling device 
20 selects values in the output-DDCS to cause output 
device 30 to generate image 37 (step 281 ) containing 
patches of colors that are inside the current output de- 
vice gamut. Input device 10 scans image 37 (step 282) 
to generate values within input-DDCS, which input de- 
vice map 21 and output device map 23 collectively trans- 
form into values in the output-DDCS (step 283) accord- 
ing to some transformation such as f c discussed above. 
In some embodiments, input-device map 21 and output- 
device map 23 are merged into a single LUT to reduce 
the amount of memory required to store the transforma- 
tion. In such embodiments, the recalibration technique 
described here is especially attractive. Because the out- 
put device gamut has changed, some of the values ob- 
tained from output device map 23 will differ significantly 
from the corresponding values used to generate the 
color patches. 

[0127] These differences can be expressed as a 
transform e: CMY CUR — > CMY ORIG that maps color co- 
ordinates CMY CUR pertaining to the current output de- 
vice gamut to color coordinates CMY OR(G as they per- 
tain to the original gamut. By deriving the inverse func- 
tion e* 1 : CMY OR | G CMY CUR (step 284), recalibrate 
map 22 can apply appropriate correction to obtain prop- 
er values for output device 30. This inverse function is 
referred to herein as a recalibration transformation. 
[0128] In one embodiment, the recalibration transfor- 
mation is implemented as a LUT. The recalibration LUT 
includes information in each table entry indicating 
whether the respective point represented by that table 
entry is inside or outside the current output device gam- 
ut. During operation of the color image reproduction sys- 
tem, referring to Figs. 10 and 19, input device 10 scans 
an original image (step 291 ), output device map 23 sub- 
sequently obtains an interim mapping of pixels in the 
output-DDCS (step 292) and recalibrate map 22 selec- 
tively applies the recalibration transformation to these 
mapped pixels as required. This is accomplished by 
identifying the four points in output-DDCS (step 293) 
that define the smallest tetrahedron enclosing the color 
point for a respective pixel, and interrogating the recal- 
ibration LUT entries (step 294) for these four points to 
determine if all are within the current output device gam- 
ut. If all points are in the current output device gamut, 
the recalibration transformation is applied (step 295) by 
performing interpolation among those four points in the 
recalibration LUT The results of this interpolation is 
used to control output device 30 for that particular pixel. 
[01 29] If at least one of the four points is not within the 



current output device gamut, the results obtained from 
the original output device map 23 is project ed to the neu- 
tral-color line and clipped at the current gamut boundary 
(step 296). This point at the boundary is used to control 
5 output device 30 for the respective pixel. 

[0130] Fig. 11 illustrates major components of one 
way for using the recalibration transformation discussed 
above. Path 71 receives information representing points 
in color space. In one embodiment, this information in- 
fo eludes an indication whether each point is in the current 
output device gamut. In another embodiment, check 
gamut 73 determines this by comparing the color space 
coordinates of each point with the location of the current 
gamut boundary 
is [0131] For either embodiment,, check gamut 73 con- 
trols switch 72 to connect with path 74 if a respective 
point p is not in the current gamut. Project and clip 76 
projects a line from point p to the neutral-color line and 
determines the intersection or clip point p' of this projec- 
ts' tion with the boundary of the current gamut. Information 
representing clip point p' is passed along path 78. 
[0132] If point p is in the current gamut, check gamut 
73 causes switch 72 to connect with path 75. Recalibra- 
tion transformation 77 implements the e* 1 transforma- 
2S tion discussed above and passes the results of this 
transformation along path 78. 



Claims 

30 

1 . A method for driving color space transformations for 
a color image reproduction system comprising an 
input device and an output device, wherein said out- 
put device has an output-device gamut including 

35 colors capable of being rendered by said output de- 
vice, said method comprises: 

obtaining a first transformation for said input 
device that maps from colors within an input- 

40 device-dependent color space to colors within 

a first device-independent color space, and 
obtaining a normalization transformation that 
normalizes information obtained from said first 
transformation with respect to a white point in 

4 5 a second device-independent color space. 

2. A method according to claim 1 wherein said first 
transformation is obtained by a process that com- 
prises: 

so 

generating coordinate values for points in said 
tnput-device-dependent color space by scan- 
ning a medium conveying a plurality of first ar- 
eas having different first color characteristics, 
55 obtaining coordinate values for points in said 

first device-independent colors space repre- 
senting said first color characteristics, 
defining a first initial transformation that maps 
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from points in said first device-independent 
color space to corresponding points in said in- 
put-device-dependent color space, and 
deriving said first transformation from said first 
initial transformation such that, 5 

for a color within said output-device gamut, 
said first transformation is defined by inter- 
polation of point values within said first de- 
vice-independent color space, and io 
for a first color outside of said output-de- 
vice gamut, said first transformation is de- 
fined by a point in said first device-inde- 
pendent color space that corresponds to 
an intersection of a boundary of said out- '5 
put-device gamut with a projection be- 
tween a point representing said first color 
and a neutral-color line. 

A method according to claim 1 or 2 that further com- 20 
prises obtaining a second transformation for said 
output device that maps from colors within said sec- 
ond device-independent color space to colors with- 
in an output-device-dependent color space, where- 
in said second transformation is obtained by a proc- 2s 
ess that comprises: 

generating coordinate values for points in said 
output-device-dependent color space and, in 
response thereto, producing a medium convey- 30 
ing a plurality of second areas having different 
second color characteristics, 
measuring the color characteristics of said plu- 
rality of second areas and generating coordi- 
nate values for points in said second device- 35 
independent color space representing said 
second color characteristics, 
defining a second initial transformation that 
maps from points in said input-device-depend- 
ent color space to corresponding points in said 40 
second device-independent color space, and 
driving said second transformation from said 
second initial transformation such that, 

for a color within said output-device gamut, 
said second transformation is defined by 
interpolation of point values within said 
second device-independent color space, 
and 

for a second color outside of said output- so 
device gamut, said second transformation 
is defined by a point in said second device- 
independent color space that corresponds 
to an intersection of a boundary of said out- 
put-device gamut with a projection be- 55 
tween a point representing said second 
color and a neutral-color line. 



4. A method according to claim 1 or 2 that further com- 
prises deriving a transformation that compresses 
luminance levels of values derived from said first 
transformation into a range of luminance levels 
within said output-device gamut. 

5. A method according to claim 1 or 2 that further com- 
prises comparing values obtained from said nor- 
malization transform with one or more thresholds 
and modifying those values having specified rela- 
tionships with said thresholds to represent said 
white point. 

6. A color image reproduction system comprising an 
input device, an output device and a controlling de- 
vice, wherein said output device has an output-de- 
vice gamut including colors capable of being ren- 
dered by said output device, said controlling device 
comprises components that: 

receive first signals from said input device rep- 
resenting in an input-device-dependent color 
space one or more colors appearing in an orig- 
inal image, 

generate second signals according to a first 
transformation that transforms information rep- 
resented by said first signals in said input-de- 
vice-dependent color space into information 
represented by said second signals in a first de- 
vice-independent color space, and 
generate third signals according to a normali- 
zation transformation that transforms informa- 
tion represented by said second signals in said 
first device-independent color space into infor- 
mation represented by said third signals in a 
second device-independent color space by 
normalizing said second signals with respect to 
a white point within said second device-inde- 
pendent color space. 

7. A system according to claim 6 wherein, for obtaining 
said first transformation, said controlling device 
comprises components that: 

generate coordinate values for points in said in- 
put-device-dependent color space by scanning 
a medium conveying a plurality of first areas 
having different first color characteristics, 
obtain coordinate values for points in said first 
device-independent color space representing 
said first color characteristics, 
define a first initial transformation that maps 
from points in said first device-independent 
color space to corresponding points in said in- 
put-device-dependent color space, and 
derive said first transformation from said first in- 
itial transformation such that, 
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for a color within said output-device gamut, 
said first transformation is defined by inter- 
polation of point values within said first de- 
vice-independent color space, and 
for a first color outside of said output-de- s 
vice gamut, said first transformation is de- 
fined by a point in said first device-inde- 
pendent color space that corresponds to 
an intersection of a boundary of said out- 
put-device gamut with a projection be- 10 
tween a point representing said first color 
and a neutral-color line. 

A system according to claim 6 or 7 wherein, for ob- 
taining a second transformation for said output de- *5 
vice that maps from colors within said second de- 
vice-independent color space to colors within an 
output-device-dependent color space : said control- 
ling device comprises components that: 

20 

generate coordinate values for points in said 
output-device-dependent color space and, in 
response thereto, producing a medium convey- 
ing a plurality of second areas having different 
second color characteristics, 25 
measure the color characteristics of said plu- 
rality of second areas and generating coordi- 
nate values for points in said second device- 
independent color space representing said 
second color characteristics, 30 
define a second initial transformation that maps 
from points in said input-device-dependent 
color space to corresponding points in said sec- 
ond device-independent color space, and 
derive said second transformation from said 3$ 
second initial transformation such that, 

for a color within said output-device gamut, 
said second transformation is defined by 
interpolation of point values within said 40 
second device-independent color space, 
and 

for a second color outside of said output- 
device gamut, said second transtormation 
is defined by a point in said second device- *s 
independent color space that corresponds 
to an intersection of a boundary of said out- 
put-device gamut with a projection be- 
tween a point representing said second 
color and a neutral-color line. so 

A system according to claim 6 or 7 wherein said 
controlling device further comprises components 
that derive a transformation that compresses lumi- 
nance levels of values derived from said first trans- 55 
formation into a range of luminance levels within 
said output-device gamut. 



10. A system according to claim 6 or 7 wherein said 
controlling device further comprises components 
that compare values obtained from said normaliza- 
tion transform with one or more thresholds and 
modifies those values having specified relation- 
ships with said thresholds to represent said white 
point. 
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an output device 



- (57) The present invention is directed to a method 
and apparatus for improving color matching between 
original color images and reproductions thereof. In the 
present invention, color space transformations are de- 
rived for a color image reproduction system comprising 
an input device (21) and an output device (23) by ob- 



taining a first transformation for the input device that 
maps from colors within an input-device-dependent 
color space to colors within a first device-independent 
color space, and obtaining a normalization transforma- 
tion that normalizes information obtained from the first 
transformation with respect to a white point in a second 
device-independent color space. 
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